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Abstract 

Consider a spin system obtained by coupling two distinct Sherrington-Kirkpatrick 
(SK) models with the same temperature and external field whose Hamiltonians are 
correlated. The disorder chaos conjecture for the SK model states that the overlap 
under the corresponding Gibbs measure is essentially concentrated at a single value. 
In the absence of external field, this statement was first confirmed by Chatterjee [2]. 
In the present paper, using Guerra's replica symmetry-breaking bound, we prove 
that the SK model is also chaotic in the presence of external field and the position of 
the overlap is determined by an equation related to Guerra's bound and the Parisi 
measure. 

Keywords: Chaos problem, Guerra's replica symmetry-breaking bound, Parisi formula, 
Parisi measure, Sherrington-Kirkpatrick model 

1 Introduction and Main Results 

Let us begin by recalling the definition of the Sherrington-Kirkpatrick (SK) model and 
the Parisi formula. Suppose that £ : R — > R is a convex function satisfying = £(— x), 
> if x 7^ 0, and > if x > 0. For each N, we consider a centered Gaussian 
process H = indexed by the configuration space Sjy = {-1,+1} JV with covariance 

EH N (cr 1 )H N (cr 2 ) = N£(R lft ), 

where 

i<N 

is called the overlap of the configurations cr 1 and cr 2 . Let h be a random variable and 
[hi)i<N be i.i.d. copies of h. Then the SK model with external field h possesses the 
Hamiltonian, 

-H{a) + ^ hj(T U (T = (cti, <t 2 , . . . , a N ) e Sjv 

i<N 
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and its corresponding Gibbs measure is denned as 

G N (cr 



\- exp ( -H(tr) + ^ hiOi ) 



where Zn is a normalizing factor, called the partition function. Let us also define 
p N = ^^log Z N = jjElog ^2 ex P ( - H ( (T ) + z2 hi(Ji ) ' 

This quantity is usually called the free energy for the SK model in physics and its ther- 
modynamic limit lim a^— >oo P n can be computed by the Parisi formula described below. 
Consider an integer k > and numbers 

m : m = < m x < . . . < m k < m fc+1 = 1 
q : go = < qi < . . . < q k+ i < qk+2 = 1- 

It helps to think of the triplet k, m, q as a probability measure fi on [0, 1] that has all 
its mass concentrated at a finite number of points qi, ■ ■ ■ ,qk+i and /i([0,g p ]) = m p for 
1 < p < k + 1. Let z , . . . , Zk+i be independent Gaussian r.v.s with Ez% = ^'(g p +i) — £'(<?p) 
for < p < k + 1. Starting with 



X k+2 = log cosh I h + ^ z v\ 

\ 0<p<fc+l / 



we define by decreasing induction for 1 < p < k + 1, 

X p = — log E p exp m p X p+1 , 

where E p means the expectation on the r.v.s z p , z p+ i, . . . , Zk+i- If rn p = for some p, we 
define X p = E p X p+ i. Finally, we define X = EX\. Set 

y fe+1 

V{Z, h, fi) = V k (m, q) = log 2 + X - - ^ m p (9(q p+1 ) - 9(q p )), (2) 

P =i 

where 9(x) = x(,'(x) — We define V((,, h) = inffc )m , q 'Pfc(m, q), where the infimum is 
over all choices of k, m, and q as above. Then the Parisi formula says that the thermo- 
dynamic limit of the free energy can be computed as 

lim p N = V(£,h). 

This formula was first rigorously proved in Talagrand [8]. 

We are now ready to formulate the disorder chaos problem in the SK model. Let 
< t < 1. Suppose that H 1 = Hjf and H 2 = H 2 N are two centered Gaussian processes 
having the same distribution as H and they are correlated in the following way, 

EH 1 (a 1 )H 2 (a 2 ) = Nt^R 1:2 ). (3) 
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That is, we allow a portion 1 — t of independence between two systems. Consider the 
coupled Hamiltonian 



i<N 

^2 



on Ejy. Proceeding as before, we define its corresponding free energy and Gibbs measure, 
respectively, by 

z' N = ex p \-h\v 1 ) - #v 2 ) + E + 



i<JV 



and 




Gn' (<x\ <r 2 ) = ±- exp V) - tf> 2 ) + £ + a 2 ) 



j<Af 



In the case of t = 1, that is, i/ 1 = H 2 and G"^ = G^ 2 , the limiting distribution of the 
overlap under G' N is known to be nontrivial on the low temperature regime. If < t < 1, 
the conjecture of disorder chaos states that the overlap takes only essentially one value 
under G' N . The phenomenon of chaos itself was first conjectured by Fisher and Huse 
[3]. Early discussion on the disorder chaos for the SK model can be found in [TJ and 
[6]. For further references in the physics literature, one may refer to [5]. However, the 
mathematically rigorous results have appeared only lately. In the absence of external 
field, Chatterjee j2] recently confirmed this conjecture and discovered that the overlap is 
concentrated at 0. 

In the present work, we aim to prove that the disorder chaos conjecture also holds 
in presence of external field. Moreover, we find that when there is chaos, the position of 
the overlap can be described by an equation, which is related to the Parisi measure and 
can be formulated as follows. Suppose that is a Parisi measure and c is the smallest 
value of the support of /i. Recall from the Definition 14.11.5 in [12], fi is the limit of a 
sequence of stationary measures (fi n ) and V(^,h,fi n ) — >• V(^,h). For each fi n , consider 
$ n : R x [0, 1] — )• R satisfying 



^ = -—{^ + ^ q]) {-d^) ) (4) 

with 1) = log cosh x. We conclude from [9] that ($ n ) converges uniformly and denote 

its limit by Furthermore, [9] also implies that the partial derivative of $ with respect 
to x exists. For each < v < 1, we define 

<p v {u,t) = E—(h + xi,v) — (h + xi,v) -u (5) 
ox ox 

for < u < v and < t < 1, where \i an d X2 are jointly Gaussian with E\\ = E\\ = 
£,'(v) and EX1X2 = t£'(u). In particular, when v = c and < t < 1, we are able to 
determine the number of the solutions of ip c (-,t) = 0. 

Proposition 1. For each < t < 1, there exists a unique Ut in [0, c] such that (p c {ut, t) = 
0. Moreover, (p c (c, t) < for < t < 1 and (p c (c, 1) = 0. 
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Now, the quantitative result of the disorder chaos in the SK model is stated as follows. 

Theorem 1. Suppose that < t < 1 and Eh 2 > 0. Then the SK model has disorder 
chaos, namely, for any e > 0, the following holds 

EG' N ({(<t\<t 2 ) : \R h2 -u t \ > e}) < K exp (-^j , (6) 

where K is a constant depending on t,£,h,e, and \x. 

A consequence of Theorem [1] is that even though we do not know that the Parisi 
measure \i is unique, the quantity u t is independent of the choice of fi. However, the 
convergence rate K in (jB} does depend on fi. In [9] and [10], other types of chaos problems 
in the SK model are also proposed, such as, chaos in temperature and chaos in external 
field. Again, the rigorous results are still scarce. Theorem [T] is the first result in chaos 
problems of any kind in the SK model with external field. To the best of our knowledge, 
the only other two instances of chaos problems in spin glasses are in the work of Chatterjee 
[2] , who proved chaos in disorder in the SK model without external field and in the work 
of Panchenko and Talagrand [7J , who established chaos in external field in the spherical 
SK model. 

The approach of the present paper is motivated by Talagrand's proof of the positivity 
of the overlap in the SK model, see Section 14.12 [12]. We also refer to a sketch of 
a possible proof for the disorder chaos problem discussed in Research Problem 15.7.14. 
|12j . From these, we prove that 

Proposition 2. Let < t < 1 and Eh 2 > 0. For e > 0, there exists some e* > such 
that 

p u>N :=±E\og Yl exp(-H 1 (cr 1 )-H 2 ( ( T 2 ) + J2hMl + ^)) <2V(^h)-s*, 

Ri 2=u V i<N J 

(7) 

for all \u — Ut\ > s, where e* is a constant depending on t, £, h,e, and [i. 

As an immediate consequence of the Gaussian concentration of measure phenomenon, 
see Theorem 13.4.3 in [T2], Theorem [T] follows from Proposition |5J Let us continue by 
giving a brief description of how we proceed to prove Proposition |5J The approach for 
proving ([7]) is based on the Guerra replica symmetry-breaking bound that was used in [S] 
for two coupled systems at the same temperature and external field. We then divide our 
discussion into three cases: — 1 < u < 0, < u < c', and c' < u < 1, where d satisfies 
c' > c and is very close to c. In the presence of external field, we adapt a similar argument 
as Talagrand's proof to conclude fl7J for — 1 < u < 0. In the case that < u < c', if 
there is chaos, the system should exhibit "high temperature behavior" and u t should be 
determined by an equation related to the Parisi measure as is the case of the classical SK 
model in the high temperature regime, see Chapter 2 in |llj . This observation then leads 
to (J7J. The most difficult part of our study is the case when d < u < 1. We establish an 
iterative inequality, which is very sensitive to the parameter t. From the construction of 
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the Parisi measure, we are able to find parameters such that (|7D holds even in the absence 
of external field. 

The paper is organized as follows. Throughout the whole paper, we assume that the 
external field h satisfies Eh 2 > and every Gaussian r.v. is centered. In Section [2j we 
first give the formulation of an extended version of Guerra's replica symmetry-breaking 
bound and explain why this is applicable to our study. We then continue to carry out 
the core of the proof of Proposition [2j In Section [3j we state some results that help to 
control Guerra's bound. Most of their proofs can be found in [12]. Section H] is devoted to 
proving (0) for — 1 < u < based on the same argument as the Section 14.12 in [12]. In 
Section El we study how Guerra's bound relates to the definition of <p v and give the proof 
of Proposition [TJ Together they imply (JTj) for < u < c'. Finally, we develop an iterative 
inequality and prove ([7]) for c' < u < 1 in Section El 



2 Methodology 

Let us first state an extension of the Guerra replica symmetry-breaking bound. Suppose 
that — 1 < u < 1 and i] e { — 1,+1} satisfies u = rj\u\. For a given integer k > 1, we 
consider numbers 

1 < T < K,T G N 

n = < ni < ■ ■ ■ < < n K = 1 (8) 
Po = < pi < ■ ■ ■ < p T = \u\ < p T+1 <■••< p K+1 = 1. 

For < p < n, suppose that we are given independent pairs of jointly Gaussian r.v.s 

E{yif = E{yif = - e(p P ) 

such that 

Eyly 2 p = Vt{e{Pp+i) - SW) if < V < r 

and 

Up and Up are independent if r < p < k. 

For our convenience, from now on, we set sh(x) = sinhx, ch(x) = coshx, and th(x) = 
tanh x. Starting with 

y k+1 = log i ch i h + vl ) ch ( h + y2 p) chA 
+shlh+ yl) sh ( h + yl ) shA ) ' 

\ 0<p<K / \ 0<p<K / / 

we define by decreasing induction for p > 1, 

Y p = — log E p exp npYp + i , 
n p 

where E p denotes expectation in the r.v.s for n > p. In the case of n p = for some p, 
we set Y p = E p Y p+ i. Finally, we define Yq = EY\. 
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Theorem 2. We have 



Pn, u <21og2 + Y -Xu-(l + t) n v( d (Pv+i) ~ e (Pv)) 

_ °" P<T (9) 

- E n p (9(p p+l )-9(p p )). 

T<p<K 

Recalling Guerra's original bound [I], is a kind of two dimensional extension. Its 
proof and a more generalized version can be found in Section 15.7 [12J. We now check 
that for any triplet k, m, q, we can find parameters (IE]) such that the right-hand side of 
([9]) is equal to 2'Pfc(m, q). Let k, m, q satisfy ([I]) and r with 1 < r < k + 2 satisfying 

Qt-i < \u\ < q T . 

Without loss of generality, we may assume that \u\ is in the list of q. Indeed, we can 
always consider a new triplet k + 1, m', q' obtained by inserting \u\ into q and keeping m 
fixed in the following way: 

m' :vn! = m p for < p < r — 1, m p _i if p = r, and m p _! ifr+l<p<A;-|-2 
q' '-Qp — Qp f° r < p < r — 1, \u\ if p = t, and q p _i for r + 1 < p < k + 3. 

Then \u\ is in the list of q' and from (j2j), one can easily check that "P/c(m, q) = Pfc + i(m', q'). 
Let us notice that this concept, though simple, will simplify many of our future discussions. 
We specify the following values for (JHJ) : 

« = k + 1 

n p = ^ if < p < t and m p if r < p < k (10) 
p p = q p for < p < k + 1 . 

Let A = 0. From Theorem [2], it follows that 
Pn <21og2 + F - 

m p {9{q p+ i) - 9{q p )). 

0<p<fe+l 

Let 

Uoi Hoi ■ ■ ■ 1 Uk+ii Vk+i be jointly Gaussian r.v.s defined in Theorem [2j For i — 1,2, we 
define (X^) < p < k+2 in the same way as (X p ) < p < k+2 by using k, m, q, and (y p ) < p <k+i- Since 
2/p and y p are independent of each other for each r <p < k + 1, it implies y r = + X^. 
To bound Vq from above, we need the following lemma, which can be proven by following 
the same idea as Proposition [T2l in Section [6] of this paper and is left as an exercise. 

Lemma 1. Suppose that rj is a constant which takes value 1 or —1. Consider two jointly 
Gaussian r.v.s yi andy 2 such that Ey\ = Ey\ and Eyiy 2 = rjtEyf. Consider two functions 
Fi and F 2 such that their first four derivatives are uniformly bounded. Then for any values 
of Xi, x 2 and m > we have 

log^exp— — (Fi(xi +y x ) + F 2 (x 2 + y 2 )) < }] — log EexpmFj(xj + yj). (11) 

m l + t ^— ' m 

3=1.2 
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Now, since yl and y 2 satisfy Ey^y 2 = rjtE{i)^) 2 = r]tE(y 2 ) 2 for < p < r, using (TTTT) 
and decreasing induction, Y < X$ + Xq = 2X . Hence, we conclude that for any given 
numbers k, m, q, we can find parameters (jSJ) such that Pfc(m, q) can be recovered by the 
right-hand side of (jSJ). We then expect that ([7| holds by suitable choice of parameters. 
It turns out that this can be done and leads to the following three crucial propositions. 
They are the main ingredients of the proof of Proposition [2] and their proofs are deferred 
to Section HJ [5j and El respectively. 

Proposition 3. For < t < 1, there exists a number e* < depending only on t, £ ; and 
h such that for every u < 0, p u ^ < 2V(£, h) — e* . 

Proposition 4. For < u < c and < t < 1 we have 

p u , N <2V(^h)-^ c (u,t) 2 . (12) 

If < t < 1, then there exists a 7 > depending on \i and t such that 

Pu,N<2V(^h)~^-ip c (c,t) 2 (13) 
lo 

for every c < u < c + 7. 

Proposition 5. Suppose that < t < 1 and c < d < 1. T/ien t/iere exists e* > suc/i 
t/iat p U) 7v < 2V(C,, h) — £* /or even/ c' < w < 1, where e* depends only on t, £, /i, c'. 

Proof of Proposition [2t Let < t < 1. From Proposition [3], there exists £^ depending 
only on t, £, and /i such that for every — 1 < u < 0, 

P«,jv<2P(e,fc)-e;. (14) 

Now, for given e > 0, we set 

£ 2 = 2 nnn {v 9 c(w, t) 2 : < w < c, \w — u t \ > . 
Since u t is the unique solution of <f c (-,t) in [0, c], it follows that £3 > and from ( fl2l) . 

P«,Ar<2P(e,/i)-e; (15) 

whenever < u < c and |w — ut\ > e. Since we also know (f c (c,t) < 0, from (fl3|) . there 
exists some 7 > depending only on /x and t such that 

Pu,tf<2P(£,/i)-e5, (16) 

for every c < u < c + 7, where £3 = ^<£> c (c, t) 2 > 0. Let us put c' = c + 7 in Proposition 
Then there exists el > depending only on t, £, /i, d such that 

P«,iV < 2P(e, fc) - 4 (17) 

whenever c' < it < 1. Finally, we obtain ([7j) by combining ffT4l) . (fl"5"l) . f|T6|) . and ffTTl) to- 
gether and letting e* = min (e*, e\, e\, £4) . □ 
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3 Preliminary Results 



Let k, m, q be given by Suppose that (-2 p )o< P <fc+i are independent Gaussian r.v.s with 
EZp = £'(q p +i) — £,'(Qp)- Starting with A k+2 (x) = logchx, we define 

A p {x) — — log E exp m p A p+ i(x + z p ) (18) 
nip 

for < p < k + 1. If m p = 0, we define A p (x) = EA p+ \(x + z p ). Then it should be clear 
that 



A p lh+ Z n) 

\ 0<n<p J 



for every 1 < p < k + 2 and X = EA (h). Since we will be working with (^4 p )o< P <fc+2 for 
much of the remainder of this paper, we summarize some quantitative results in Lemma 

m 



Lemma 2. For every < p < k + 2, we have 



-p~ ^ A p( x ) ^ min ( x » T2~ ) 
3h x \ ch x J 



A p (x) - A p ( x), |4| < 1, cA ^ ^ pV ., ^ ^, ch ^j , (ig) 

I4 3) i< 4 ' i4 4) i< 8 > 

where C is a constant depending only on £. 

Proof. We only prove that ^4p(x) < C(ch 2 x) _1 . For the other statements, one may refer 
to Lemma 14.7.16 [12]. Since A p is an even function, it suffices to prove that A''(x) < 
C exp(— 2x) for x > 0. Let T\ > 1 be the smallest integer with m Tl > and t 2 < k be the 
largest integer with m T2 < 1. Suppose for the moment that there exists C\ > such that 

< C 1 exp(-2x) 

for x > and T\ < p < r 2 . By construction, for x > and < p < n, we have that 



Ap(x) 



EA T1 lx+ 

\ P <n<n / 



and then 



=EA'* i ( x + z ") 

\ p<n<ri / 

<2C 1 exp(-2a;) J Ech ( 2 ^ z n ) 

\ P <n<ri / 

=2Ci exp (2 (e'(? n ) - £'(<&,))) exp(-2x); 
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for x > and r 2 < p < + 2, it is easy to see that 

^p(ar) = log£ch | x + Z A= lo S cha; + ~ 

\ p<n<fc+2 / 

and so = -A- < Co exp(— 2x) for some constant Co > 0. If we set 

p Clli 

C = max(C , 2 ,2Ciexp(2^ , (l))), 

then Ap(x) < Cexp(— 2x) for x > and < p < k + 2. So in the following, we may 
assume, without loss of generality, that < mi, < 1 and 1 < p < k. 

For p' with p < p' < k and j p ,j p +i, ■ ■ ■ ,j p >-i £ N, we consider a non- increasing rear- 
rangement /.^OieN °f a Poisson point process of intensity measure x~ m p'~ 1 dx. 
All of these are independent of each other. For a = (j p ,j p +i, ■ ■ ■ ,jk) € N fc+1_p , we set 



U a — U jp U jpj P +i ' ' ' U jpj P +i---jk 



and 



For each p' with p < p' < k, let us consider a sequence of independent copies of z p >, 

( z p' Jp Jp+u- dp' ) jp ,jp+ 1 , • • -Jp> eN ■ 
These sequences are independent of each other and of (■uj pJ p +1 ...j / _ 1 j)jeN for p < < A; 
and jp,j p+ i, . . -,j P '-i e N. To simplify the notation, for a = {j p ,j p+1 , ...,j k ) € N k+1 ~ p , 



Zp',a z p',jp,jp+i,---,j p >- 



we write 



Then from Theorem 14.2.1 in [12] , 

= £log^z/ a ch (x + z a ) + -(£'(1) - Z'{q k +i)) 

a 

where 

p<p'<k 

Taking derivatives, we obtain 



a;( x ) =i-e 



J2a V a sh(x + Z a ) 

Z-a j 



-E 



Y, a z^(ch(x + z a ) - sh(x + z a )) 
v a ch(x + Zg) 

Y,g y a {c\l(X + Zg) + Sh(x + Zg)) 



Y,g ^ Q Ch(x + Zg) 

.Y.a ly c l ch(x + Z a )J 

^ I %TW exp( " 2l) ' 

Z^a e^-p^ a j y 
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where the first inequality holds since chy — shy = exp(-y) and \shy\ < chy, while the 
second inequality follows from 2chy > exp y. Let us now turn to the computation of this 
quantity 

X a ^exp(-z a )' 



7p := E 

V Z^^exp^J 

Set F(x p , x p+ i, ...,x h ) = Y,p< P '<k V for ( x p> x p+i> • • • > x k) ^ K fc+1 ~ p - For a E N fe+1 ~ p , 
define the random variables 

F(a) =F(z P!a , z kt „) 



Then we can write 



Starting from 



U(a) =exp(-2F(a)). 



P Ea v* exp F(a) 



F\Z p: 2p _ i . . . . , £fc), 

we define by decreasing induction for p < p' < k, 

Fp< = — log Ep< exp rripiFpi+t, 
trip' 

where E p / means the expectation with respect to the r.v.s z p >, z p > + i, . . . , z k - We also define 
for p < p' < k, 

Wpi = expm p /(F p / + i - F p >). 
From formula (14.27) in [12], (1201 can be computed as 

lp = E (W P W P+1 ---Wk exp (-2F k+ i)) . (21) 
Using the independence of z p , z p+ \, . . . , z k , it is easy to compute that 

p'-i 1 fe 

n=p n=p' 

Therefore, we obtain 

( m l' \ 

Wpi =exp lm p ,z p - — ~ HQp')) ) 

and from fl2T]) . this implies 

/ k k N 

7 P =£exp I ^(rry - 2)z p/ - - my(£'(g p / + i) - 

\p'=p p'=p / 

= ex P ]T ((tv - 2) 2 - mj,) (e'(%/+i) - £'(<&/)) 
\ p'=p 



p'=p 

k 



exp 2 (1 - Try) (C'(g P '+i) - 



p'=p 



<exp(2£'(l)). 



10 



Finally, we are done by letting C = 4exp(2£'(l)). □ 

As a consequence of Lemma [2j we have the following lemma. 

Lemma 3. There exists a number M depending only on £ and h such that for every 
0<p<k + 2, 

E (A' p (h + X [)A p (h + X ' 2 )) > (22) 

E{A;(h + x'l)A;(h + x^)>jj, (23) 

where x[, x'n Xi-> x'i are jointly Gaussian r.v.s with the same variance £, ; (q p ) and Ex'iX'2 = 
0. 



Proof. The first inequality is Lemma 14.12.8 [12] and from there, a similar argument 
yields the second inequality. □ 

Recall that the external field h in this paper is always assumed to satisfy Eh 2 > 0. 
Based on this assumption, we set up the definition for the Parisi measure from [T2] . 

Definition 1. Given e > we say that k, m, q satisfy condition MIN(e) if the following 
occurs. First, the sequences 

m =(m , mi, ... , m k , m k +i) 
CL=(q ,q l} ...,q k+1 ,q k+2 ) 



satisfy 



In addition, 
and 



m =0 < mi < . . . < m k < m k+1 = 1 
g =0 < qi < . . . < q k +i < qk+2 = 1- 

V k (m,q) <V{£,h)+e 



V k (m,q) realizes the minimum ofV k over all choices of m and q. 

Definition 2. Suppose that \x is a probability measure associated to k, m, q. Then we say 
that fi is e-stationary for some e > if k, m, q satisfy condition MIN(e). 

Definition 3. We say that a probability measure \x is a Parisi measure (corresponding 
to the function £ and external field h) if there exist a sequence (s n ) with e n 1 and a 
sequence of probability measures (/i n ) such that the following two conditions hold: 

H n is e n - stationary (24) 
/1 is the limit of (ji n ) (25) 
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Definition [TJ is the same as Definition 14.5.3. [12], while our definition on the sta- 
tionarity in Definition [2] is stronger than that in Definition 14.11.4. [12]. This is just 
for technical purposes and it should be clear that under these assumptions, our future 
arguments are still valid. 

Lemma 4. Suppose h ^ and k, q, m satisfy condition MIN(e). Then for 1 < p < k + 1 

E(W 1 ---W^ 1 A' p (Q 2 ) = q P (26) 

e'(q P )E (Wi • • • WVi^'(Cp) 2 ) < 1 + M£l/6 > ( 27 ) 

w/iere ( p = h + Xlo<n<p z n an d 

W p = exp m p (A p+1 (C P+ i) - A p (( p )) = expm p (X p+ i - X p ). 

Here, M is a constant depending only on £ and h. 

Proof. These results are (14.222) and (14.461) in [12]. □ 

At the end of this section, we will find a manageable bound for Pu,n via Guerra's 
bound. Recall that the right-hand side of © depends on (jSJ). If we keep every parameter 
but A fixed, then it is a quantity depending only on A, and for clarity, we denote it by 
a(A). For the same reason, we also think of Yq as a function of A. Recall the random 
variables (yp)o< P < K ,j=i,2 defined in Theorem [2j Suppose that (y p )o< P <K are independent 
Gaussian r.v.s with E(y p ) 2 = £'(Pp+i) — C'(Pp) for < p < k. Starting with 

D K+ i{x) = logcha;, 

we define D p for < p < k by decreasing induction : 

^ log E p exp n p D p+1 (x + y p ), if r < p < K, 

(j^^ log E p exp ((1 + t)n p D p+1 (x + y p )), if < p < r, 



D p (x) 



where E p means the expectation with respect to y n , y ] n for p < n < k. If n p = for some 
p, then we define D p (x) = E p D p+ i(x + y p ). For j = 1, 2 and 1 < p < k + 1, set 

c P = h+ yl 

0<n< P 

Proposition 6. If n p = for every < p < r, t/ien 

Y (0) =ED T (C) + ED T (C) (28) 
y '(o) =E (^(^^(C 2 )) • (29) 

For the second derivative ofY , we have for every A, 

< F "(A) < 1. (30) 

Proof. The proofs of fT28l) and fT29l) are essentially the same as that of the part b) of 
Proposition 14.6.4 [12]. Also, ( 130]) and Lemma 14.6.5 [12] have the same proof. □ 
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Corollary 1. We have 



p U)N < inf a(A) < a(0) - ^a'(O) 2 . (31) 

Proof. This is an immediate consequence of (1301) . □ 

Let us remark here that ( 13~TT) helps us in at least two ways: First, it reduces the 
difficulty of choosing parameters since we do not have to choose A now. Second, this 
inequality gives us a reasonable way to choose parameters. Roughly speaking, in many 
cases, we choose parameters in such a way that the quantity a(0) is very close to V(C, h), 
while the term |a'(0) 2 is the error that we expect to obtain on the right-hand side of (J7J). 



4 Proof of Proposition [3 

This section is devoted to proving Proposition [31 Our approach is based on Talagrand's 
proof of the positivity of the overlap in Section 14.12 [12]. Suppose that u = — v for 
< v < 1. Proposition [3] relies on the following two results: 

Proposition 7. There exists 5 > and Eo > depending only on £ and h with the 
following property. Whenever we can find k, m, q that satisfy condition MIN(eq) and for 
an integer s with 1 < s < k + 1, 



m s -i < 5 and q s > v — 5, 



then we can find parameters in (TJ2) such that p Ut N < 2"P(£, h) — 1/M, where M depends 
only on £ and h. 

Proposition 8. Consider 5 as in Proposition [7| Then we can find e\ > with the 
following property. Whenever we can find k, m, q such that Pfc(m, q) < "P(£, h) + E\ and 
an integer s with 1 < s < k + 1, 

m s > 5 and q s < v — 5, 

then we can find parameters in ([Pj) such that p u ^ < 2"P(£, h) — 1/M, where M depends 
only on £ and h. 

Proof of Proposition [3t Consider v > 0, 8, and Eq as in Proposition [71 Suppose that 
k, m, q is a triplet satisfying MIN(min(e , £i))- Let l<s<k + lbe the largest integer 
such that m s _i < 5. If q s > v — 5, we apply Proposition [7J Otherwise we have q s < v — 5. 
If s = k + 1, then m s = m^+i = 1 > 5. If s < + 1, then from the definition of s, m s > 5. 
In both cases, we conclude Proposition [3] by using Proposition [8] and we are done. □ 

Notice that since the proof of Proposition [8] is essentially the same as that of Propo- 
sition [51 we defer it to Section [61 Now we turn to the proof of Proposition [JJ and proceed 
with the following lemma: 
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Lemma 5. Suppose that A : K — > K /ms uniformly bounded first and second deriva- 
tives. Consider two independent pairs of jointly Gaussian r.v.s (xiiXz) an d {XiiX^)) a ^ 
of variance a, and a standard Gaussian r.v. x- Then we have 

\EA\h + X i)A\h + X2) - EA'{h + x [)A\h + x ' 2 )\ 
<\E XlX2 -E X ' lX ' 2 \EA"(h + X ^) 2 . 

Proof. This is a typical application of the Gaussian interpolation technique and the 
Cauchy-Schwarz inequality. For details, one may refer to the Lemma 14.9.5 [12]. □ 

Suppose that k, m, q is a triplet satisfying MINfV). Based on our discussion in Section 
[21 we may assume, without loss of generality, that v = q a for some a. The only thing 
we have to keep in mind is that when using fT2~Tj) . we will not be able to use the value 
p = a. From the assumption that q s > v — 5, we divide our discussion into two cases 
v — 5 < q s < v and q s > v. First, let us proceed with the case that for an integer s with 
1 < s < k+1, 

iTis-i < 8 and v — 5 < q s < v . (33) 
Note that s < a. We consider the following numbers 
t = 1 

k = k + 2 — a 

(34) 

n = 0, ni = m a , n 2 = m a+1 , ■■■ ,n K = m k+1 = 1 
p = 0, pi = v = q a , p 2 = q a +i, • • • , p K +i = Qk+2 = 1- 

and apply ( 1341) to Theorem [21 Recall that we use a to denote the right-hand side of Q). 

Lemma 6. Assuming (El) and §3J^ , we have 

a(0) < 2P fc (m,q) + M5. (35) 

Proof. The proof is the essentially the same as that of Lemma 14.12.7 in [12]. □ 



In view of ( 13~TT) and ( 1351) . our goal is then to bound a'(0) form below. Proposition [6] 
implies that D\(x) = A a (x) and so 

a'(0) = E(A' a (h + xi)<(h + X2))+ v, (36) 

where Xi an d X2 are Gaussian with E{x\) 2 = E( X2 ) 2 = (,'( v ) an d E XlX2 = —t£'(v). 
Consider two independent Gaussian r.v.s x'i an d X2 w hh E^x^) 2 = E(x' 2 ) 2 — C'( v )- By 
using 



E {A' a {h + Xi)K(h + X2)) > E{A' a {h + X [)A' a (h + X ' 2 )) ~ H'^EA'^h + xVW))\ 
where x is standard Gaussian. Since £'(t>) < v£"(v), it follows that from (1361) . 

a'(0) >E (A' a (h + X [)A' a (h + x'2)) +v(l- tt{v)EJ^{h + xVW)) 2 



^ ( 37 ) 

-E (A' a (h + X [)A' a (h + x'2)) + v(l -t)+tv(l- t"(v)EA':(h + xVW)f) • 
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To use ( 157)) . we have to bound the quantity 



?(v)EAl{h + xVW)) 
from above. The starting point of the proof is that from (J2] 

e(q s )E(W 1 ■ ■ ■ W S ^(Q 2 )) < 1 + Me 1 / 6 , (38) 
where ( p = h + J2o<n< P z n and W v = ex P m P ( A P +i(C P +i) - A»(Cp))- 

Lemma 7. Assuming (\33\i . there exists Sq > depending only on £ end /i snc/i t/iat u>/ien 
5 < 5o, we /iai>e 

£»£<(/i + xv 7 ^)) 2 < £"te)£W • • • w^icf) + mV~s. (39) 

Proof. This is Lemma 14.12.9 in [12]. □ 

As a conclusion, by assuming ( 1551) and using ( 1341 . we see that ( 122)) . ( 1571) . ( 158)) . and 
( 159)) together imply 

a'(0) > — - Me 1/6 - Mv^ (40) 

for 5 < do- 
Next, let us consider the other case that for some 1 < s < k + 1, 

m s _i < 5 and g s > u = q a . (41) 

Since g a+ i > q a > v — 5 and m a < m s „! < 5, we may assume, without loss of generality, 
that s — a + 1. Consider the following numbers 



r = 1 

k = k + 2 — a 

n = 0, ni = 0, n 2 = m a+1 , ...,n K = m k+1 = 1 

Po = 0, pi = v = q a , p 2 = q a +i, ■ Pk+i = Qk+2 = 1 



(42) 



and apply (142)) to (191). 

Lemma 8. Assuming fl^ip and fl^ffp , we /iai>e 

«(0) <2P fc (m,q) + M5. (43) 

Proof. A similar proof as Lemma [6] yields the announced statement. □ 

Again, our goal is to bound a'(0) from below. From ( 1291) . we have D 2 (x) = A a+ i(x) 
and then 

a'(0) =£ (A' a+1 (h + Xi)^a + i(^ + X*)) + v, (44) 
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where Xi an d X2 are jointly Gaussian with E(xi) 2 — E(x2) 2 = £'(?a+i) an d EX1X2 — 
— t£,'(v). Let x'i an d X2 °e two independent Gaussian r.v.s with E(x'i) 2 — -^(x^) 2 — 
£'(g a+ i). Using fl22|) . we obtain 

E(A' a+1 (h + Xl )A' a+1 (h + X2 )) 

^K+^/i + X [)A' a+1 (h + X ' 2 )) ~ te(v)EA: +1 (h + xv/^W)) 2 , 



where x is standard Gaussian. Let us apply p = a + 1 to fl27j) and use the fact g a+ i > u. 
Then we have 

e(v)E(W 1 ■ ■ ■ W a A'i +1 (Ca + if) < e(q a +i)E{W 1 ■ ■ ■ W a A'^ +l (Ui) 2 ) < 1 + Me 1 '*. (46) 
Lemma 9. Assuming fl^ip , we have 

E\W x ---W s -i-l\ <M5. (47) 
Proof. One can find the proof from Lemma 14.12.9. |12j . □ 
Using gZD and £A' a ' +1 (Ca+i) 2 = ^a +1 (A + Xv^a+i)) 2 , it follows that from flE}, 



£»£< +1 (/* + Xv/^W)) 2 < 1 + MS + Me 1 ' 6 (48) 
and from (122]). <H3j) . flip]), and < <'(t> ), we then have 

a'(0) ^(ll + + X2)) + « - ti\v)EAl +1 {h + xv/fETiT) 2 

-M" + V{1 ~ t)+ Hl ~ ?'^ EA "+^ h + ^V 7 ? 7 !^)) 2 ) (49) 

>— -M5-Me 1/6 . 
~M 

Proof of Proposition O First we complete the proof for the case (1331) . Let Mi be the 

constant obtained from ( 15o^) and ( 14"0]1 and assume, without loss of generality, that M x > 1 
and 1/16M? < 6 . Set 5 = 1/lQMf. If e < e x = (1/AMf) 6 , (SO]) implies 

, m > ±_ Mi_ Mi _ 1 



Mi 4Mf 4Mf 2Mi 
and combining this with ( 1351) yields 

inf a(A) < 2P fe (m, q) + M x 8 - ^ < 2P(£, h) + 2e - 

Letting e be sufficiently small completes our proof of this case. For the second case ( jSj) , 
using (14*9]) and Lemma [8], we may argue similarly to obtain the announced result. 

□ 
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5 Proof of Proposition 3 

For given < v < 1, recall the definition of <p v from fl5]). In this section, we first study how 
the Guerra bound relates to ip v and then study some of its basic properties to conclude 
Propositions [H and HI 

Let k, m, q be given by ([I]). Suppose that /i is the probability measure associated to 
k, m, q and $ is the corresponding solution of @. Recall the definition of (v4 p ) < p < fc+2 
from f rrgj) . Then $ and (^4 p )o< P <fc+2 can be related in the following way. Let (g p )o< P <k+i 
be i.i.d. standard Gaussian r.v.s. For q £ [0, 1] , we have that $(x, 1) = Ajt +2 (x) if q = 1 
and 



= — log E exp m p ylp + i ^r + # p y£' {q p+1 ) - £'(q) 

if 9p < q < Qp+i for some < p < A; + 1. In particular, for < p < /c + 2, 

$(x,g p ) = A p (x). (50) 

For fixed u and v with < u < v < 1, we suppose q a < v < q a+ \ for some < a < k + 1 
and consider numbers 

T =1 

k =k + 3 — a 

51 

n =0, ni = 0, n 2 = m a , n 3 = m a+ i, . . . , n K = m fc+1 = 1 
Po =0, pi = u,p 2 = v, p 3 = g a+ i, . . . , p K+ i = q k+2 = 1. 

Let us apply (I5TT) to ([8]) and recall that we use a (A) to denote the right-hand side of (Q. 

Lemma 10. For < 5 < c, we have 

a(0) <2P fc (m, q) + /i([0, c - 5])0(1) + - 0(c - 8)) + . (52) 

T/ie derivative of a at can 6e computed as 

a'(0) ^ fa + *0^fa + X2) - u, (53) 

where Xi andx2 are two Gaussian r.v.s with E(xi) 2 — E(x2) 2 = C( v ) an d EX1X2 = t£,'{u). 

Proof. Without loss of generality, we may assume that v = q a and u = q^ with < b < a. 
Let us write 



where 



n p (9(p p+l ) - 9{p p )) = Y m p( e (%+i) ~ 

l<p<K a<p<k+l 

= ^ m p (6(q p+1 ) - 6{q p )) - C, 
i<p<k+i 



C= rn p (6(q p+1 )-6(q p )). 

l<p<a-l 



(54) 
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If Qa < c — 5, then 

C<max{m p :g p <c-5} ^ - 9{q p )) < fi ([0, c - 5]) 9(1); 

0<p<a-l 

if q a > c — 5, then 

C < max {m p : q p < c - 5} (% P +i) - %p)) + X] %P+0 _ %p) 

0<p<a-l 0<p<a-l:g p >c-<5 

<^ ([0, c - 5]) 6(1) + fl(n) - 0(c - 5). 

So ( )52l) holds. From (128j) . we have D2(x) = A a (x) and then Y"o = 2EA a (h + x) , where 
X is Gaussian with i?x 2 = £'(<?a)- Since x has the same distribution as Xlo<p<a z p' f rom 
Jensen's inequality, A p (x) > EA p+1 (x + z p ) and iterating this inequality implies 

EA a lh+ z p) < E Mh)- 

\ 0<p<a J 

So Y < 2EA (h) = 2X and this together with ([54]) yields ([52]). Next, using ([29]) and 
([50]) . we obtain 

F '(0) =EA' a (h + xi)A' a (h + X 2) 

=E — {h + Xl, Va)-Q^( h + X2, q a ), 

where Xi an d X2 are jointly Gaussian with E(xi) 2 — E(x2) 2 = £'(<?a) and EX1X2 = t£,'(<lb)- 
This completes our proof. 

□ 

Now, suppose that \x is a Parisi measure and c is the smallest value of the support 
of /i. By Definition |3] /i is the limit of a sequence of stationary measures (fi n ) such that 
V(£,,h,fi n ) — > V(£,,h). By Definition [2] for each there exist k, m, q and £ > such 
that k, m, q satisfy MIN(e). Here, to clarify notation, we keep the dependence of k, m, q, 
and e on n implicit. For u and v satisfying < u < v < 1, we consider numbers ( 1511) 
associated to u, v , and /i n , and we use a n to denote the right-hand side of Q). Suppose 
that is the solution of (Jl]) associated to fi n . Recall that we define $ as the uniform 
limit of An argument similar to the proof of Theorem 3.2 [9] implies that in the 

sense of uniform convergence, 

hm 



Ox 1 n-s-oo <9x l 

on R x [0,1] for z = 1,2,3. 

Proposition 9. For any n and n satisfying < u < v < 1, we have 

limsup a n (0) < 2V{C, h) + (6(v) - 0(c))+ (55) 

n— >oo 

and 

(9$ (9$ 

lim <(0) = E—(h + xi, v) ir (h + X 2, v) - u, (56) 
ox ox 

where Xi and X2 are jointly Gaussian with E(xi) 2 — E(x2) 2 = C( v ) an d EX1X2 = 
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Proof. Using ( 152"|) . we have for < 5 < c, 

limsupa n (0) <2V{£, h) + limsup// n ([0, c - 6)) 0(1) + (0(v) - 0(c - <J)) + 
=ZP{Z,h) + {B(v)-0(c-S)) + 
and this implies (155]) by letting 5 tend to zero. For (1561) . we use (1351) . □ 

Let us now turn to the study of some basic properties of <p c . Recall from (J5J and (1551) . 
for fixed < u < 1, is defined by 

ip v (u,t) = lim a^(0) 

n— >oo 

for < u < v and < t < 1, where xi an d X2 are jointly Gaussian r.v.s with E(xi) 2 = 
E{x2) 2 = C( v ) an d -^XiX2 = t£,'( u )- F° r given fc, m, q, let us recall the definition of 
(v4p) <p< fc+2 from ( 1151) . We also recall the definitions of (Wp)i<p<fc+i and (Cp)i< P <fe+i from 
Lemma HI Let us proceed with the following lemmas. 

Lemma 11. Let e > and < 5 < c. Suppose that I and I' are fixed integers with 
1 </</'< k + 1. l/m p < e /or every 1 < p < I — 1, then 

E\W 1 W 2 ---Wi- X -l\ <Me. (57) 

If c — 5 < q p < qi> for every I < p < V , then 

EW X W 2 ■ ■ ■ Wi-i\WiWi +1 ■ ■ ■ W v -x - 1| < Myjq v -c + 6. (58) 

Here, M depends only on £ and h. 

Proof. Similar arguments as (14.468) and (14.469) in [12] will yield the announced results 
immediately. □ 



<9$ 



Lemma 12. We have 

E(^-(h + x,c)) =c (59) 
C(c)E(^(h + X ,c)) <1, (60) 
where \ denotes a Gaussian r.v. with Ex 2 = £'(c). 

Proof. Recall that each /i n corresponds to k, m, q, and e. Since < c < 1, for each n 
there exists some < s < k + 1 such that q s < c < q s +\- Let us first claim that 

lim E\W x ---W a ^ - 1| =0 (61) 

n—toc 

and if lim^oo q s+ i = c, then we further have 

lim E\Wf--W a - 1| = 0. (62) 

n— >oo 



19 



Let < 5 < c be fixed. Suppose that 1 < I < s + 1 is the largest integer such that 
qi-i < c — 5. Since lim^oo /x n ([0, c — 6)) = 0, we have that for large n, m p < e for every 
< p < I - 1. Using flE 



£|WaW 2 ---W*_ 1 -l| <Me. (63) 
On the other hand, since c — 5<q p <c< q s+ i for / < p < s, using ( 158|) . we also get 

£WiW 2 • • • • • • W s - X - 1| < M^/g, - c + 5 < MV^ (64) 



and 



EW l W 2 ■ ■ ■ Wi-x \WiWi +x ■ ■ ■ W a - 1| < Mv/g s+1 - c + 5. (65) 
Using the triangle inequality, (16"3"|) . and ([MD, it follows that 

limsup £ IW1W2 ■ • • W s -i - 1| < limsup EW{W 2 ■ ■ ■ |WW,+i • • ■ - 1| 

n— >oo n— >oo 

+ limsup J E|iyilU 2 - •• Wj-i - 1| 
< lim M\/5 + Me 
=Mv / 5. 

Similarly, if lim^oo q s+ i = c, using the triangle inequality, ( 1631) . and ( 1651) . we obtain 
lim sup E I !UilU 2 • • • W s - 1| < lim sup ElUilU 2 • • • | W,W,+i • • • W a - 1| 

n— >oo n— >-oo 

+ limsupE|iy 1 lU 2 ---W / i_i- 1| 



< lim My - c + 5 + Me 

71— fOO 

= lim My/5 + Me 

n— ¥00 

=MV6. 

Since 5 > is arbitrary, our claim follows. 

Now, let us assume, without loss of generality, that the following limits exist, 

lim q s , lim q s +i, lim m s 

n— »oo n— >oo rt— >oo 

and denote them by c_, c + , and m c , respectively. If c_ < c < c + , then the first inequality 
implies m c = 0, which leads to a contradiction since the second inequality implies m c > 0. 
Thus, we may assume: 

either c_ = c or c + = c. (66) 

Notice that from the stationarity of fi n , q p = if and only if p = 0, and also g p = 1 if 
and only if p = k + 2. If g s = for all but finitely many n, then s + l = l<£;+ifor 
large n and so c + = c. If g s+ i = 1 for all but finitely many n, then s = k + 1 for large n 
and so c_ = c. Finally, if < q s and g s+ i < 1 for infinitely many n, then these s satisfy 
1 < s < k and f )66|) . Hence, in the following argument, we assume further that one of the 
following cases holds: 
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(i) 1 < s < k + 1 for all n and c_ = c. 

(ii) l<s + l<A; + l for all n and c + = c. 

(iii) 1 < s < k for all n and ( 166]) holds. 

If (i) holds, then from (l26l). d27D. and d6TT). we have 



W ^-( /i + X> c ) ) = lim EA' s (h + Xs ) 2 



\ dx 



lim E(W 1 ---W s . 1 A' s (h + Xs f) 

n— too 

lim g s 



n— >oo 
-C 



and 



r( C )E ( + x , c) ) = iim + x^ 2 



< limsup£"(ft)S(Wi • • • W^A'Xh + Xsf) 

n— too 



where Xs is Gaussian with E(xs) 2 = K (ii) holds, again from fl26|) and f )27|) . we have 

£(WV--W^ +1 (/i + Xs+1 ) 2 ) = g s +i 

• • • W s A" s+1 {h + Xs+ i) 2 ) < 1 + Me 1 / 6 . 

Using f[6"i2"j) and proceeding as in (i), we obtain the announced results, where Xs+i is 
Gaussian with E(xs+i) 2 = £'(<?s+i)- Finally, for the case (iii), the same argument completes 
our proof. □ 

Proposition 10. For eachO < t < 1, tp v (-,t) is a convex function on [0,v] . ForO <u<c 
and < t < 1, 



< 0; (67) 

ou 

> iM (68) 

dt ~ m 1 

where M is a constant depending only on £ and ft,. 
Proof. Define for each n, 

<Pn,v( U i *) = °4(°) = E ~fa( h + Xl ' V ^~dx^ h + X2 ' ^ ~ " 

for < m < f and < t < 1, where xi an d X2 are jointly Gaussian with E(xi) 2 = 
E(x2) 2 = £,'( v ) an d EX1X2 = t£'(u). Again, without loss of generality, we may assume 
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that v = q a for some 1 < a < k + 1. Let g, #q, #q, g\, g\ be i.i.d. Gaussian r.v.s with 
variance C(<la) such that for £ = 1,2, 



Then <p ntV (u,t) can be written as 



where 

and for £ = 1,2, 

^(w, t) =/i + CflrV^ + gW(i-t)) V^ + g\^/T 



w. 



So for < u < v and < t < 1, by using Gaussian integration by parts, 

^(M) =^>)ri(M) - 1 (69) 
=*£ (3) («)riM) + ^» 2 r 2 (M) (70) 
^K0=eV)riKt) (7i) 

<9u<9t 



[M) ^(«)£>)r 3 (M), (72) 



where 



r x ( u ,t) =£?<(/i + X iX(/i + x2) 
r 2 ( M ,t) =E4 3 )(/ i + Xl )4 3) (^ + X2). 

Since A" a > 0, we have Ti > 0. Let us also observe that 

E [A® (yi(w,t))\ g, h] =E [A^ {V 2 {w,t))\ g, h] . 
This means T 2 > and from (170!) and (172]) . we obtain 

f!^ = ^ > 0. (74) 

Thus, the convexity of (p v (-,t) follows from (1751) . By (160|) and (169|) . we know ^f-(c, 1) < 
and from (1741) . this implies ^p-(c, i) < 0. So we obtain ( l67j) by using ( J75|) . Finally, ( )68|) 
can be easily obtained from (F25J) and (ITT]) . □ 
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Proof of Proposition [T] : Let < t < 1. Notice that if u = 0, then x x and \2 are 
independent and from fl22|) . it implies V5 C (0, t) > 0. Since </9 c (c, 1) = by f l59l) and 
^(c, t) > > from fl68|) . we conclude that (p c (c,t) < and so <£> c (-,t) has a solution 
in [0, c] . Suppose that ui, u 2 with < u\ < u 2 < c are two solutions of <p c (-, t) = in [0, c] . 
From Rolle's theorem, there exists some 113 with u\ < 113 < u 2 such that ^(u 3 ,t) = 0. 
Then the convexity of f c {-,t) and ^f(-,i) < imply that ^-(u,t) = for w 3 < -u < m 2 . 
Thus, ip c (u,t) = for M3 < -u < «2, which contradicts to the convexity of ip c (-,t) since 
¥> c (c,*)<0. □ 

Proof of Proposition H]: Combining (p))), ( )3~T1) . ( )55l) . and (l56l) . we get that for u, v, t with 

< u < v < 1 and < t < 1, 

P«,v <2P(£, /i) - -^(u, t) 2 + (9(v) - 9(c))+. (75) 

Applying v — c to this inequality, we obtain ( 1T21) . Suppose that < t < 1 is fixed. It 
is easy to see that (u,v) h-> <p v (u,t) is continuous on < u < u < 1. Since </? c (c, t) < 0, 
there exists some 7 > such that <p v (u,t) < |v 9 c(c, £) whenever c<m<w<c + 7. By 
the continuity of 9, we may also let 7 be small enough such that 6{y) — 9(c) < jg<p c (c, t) 2 
whenever c < v < c + 7. Therefore, we obtain (fTBl) from (ITS"}) . □ 



6 Proof of Proposition [5 

In this section, our main goal is to establish an iterative inequality that is used in the 
proofs of Propositions |5]and El Let us start by stating our main result as follows. Suppose 
that yi and y 2 are jointly Gaussian r.v.s with E(yi) 2 = E(y 2 ) 2 = 1 and Ey\y 2 — t > 0. 
Define 

F 1 (x 1 ,x 2 ,w) =E (th(xi +y x y/w) - th(x 2 + y 2 y/w)) 2 
F-x(xi,x 2 ,w) =E (th(xi + yiy/w) + th(x 2 - y 2 ^)) 2 

for X\,x 2 G R and < w < 1. For convenience, we sometimes simply denote Fi by 
F. Recall the constant C stated in Lemma El Set C = 2 (i+t)c 2 • ^or < H — 1j ^ 
i] G { — 1, +1} satisfy u = r]\u\. Then the following inequality holds. 

Proposition 11. There exists a constant K\ depending only on C and £ such that the 
following statement holds. Suppose that < c\ < c 2 < 1 and 

0<f(c 2 )-e(e 1 )<minQ, 2(2Coe( 1 1)+Jfi) ); (76) 

and k, m, q are snca that for some 1 < s < k + 1, 

g s < ci and m s > 5. (77) 
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Then we have 

p UtN <2V k (m,q) -C 5K 2 H EF v (h, h^'(q))C(q)dq (78) 

J 'a 

for every u with c 2 < \u\ < 1, where K 2 is a constant depending only on £. 

As consequences of Proposition [UJ Propositions |5] and [8] now follow. 
Proof of Proposition [5] : Set c 2 = d. Let us choose c\ G (c, d) such that ( 1761) holds and 
/i is continuous at c\. Since c is the minimum of the support of /i, /i([0,ci]) > 0. From 
the definition of /i, there exists a sequence of stationary measures (/%) such that /i n — >■ /Lt 
weakly and P(£, /i, /i n ) — > V(£, h). For each n, /z n corresponds to some k, m, q. We assume 
that Ci is in the list of q and C\ = q s for some 1 < s < k + 1. Then for large n, 

A*n([0,g s ]) = m s > <5, 

where 5 = |yu([0, ci]). We then apply Proposition [TP to obtain for every d < u < 1, 

Pu,at < 2"P fc (m, q) - £*, 

where = C 8K 2 EF 1 (h,h,^'(q))^"(q)dq. Since < t < 1, we have that e* > 0. 
Letting n tend to infinity completes our proof. □ 

Proof of Proposition [8] : Notice that from the given condition, we have v > 8. Let 
ci = v — 5 and c 2 = v — 5/2. Without loss of generality, we may assume that 5 > is 
small enough such that (1751) holds. Since (17T|) is satisfied and \u\ — v > c 2 , it follows that 
from (J7HD, 

P«,tv < 2P fc (m, q) - £» < 2P(£, h) - (e» - 2 £l ) 

for e*(v) = C 5K 2 EF^ 1 (h,h,^'(q))^"(q)dq. Clearly, £*(•) is a continuous func- 

tion on [5,1]. Since < t < 1 and £/i 2 7^ 0, e*(v) > for every v e [5,1]. Thus, 
min^g^i] e*(v) > and the announced result follows by letting e\ be sufficiently small. □ 

At this moment, we will explain the motivation of the proof of Proposition [TTJ Let 
us apply (TTTJT) to Theorem [2] and recall the definitions of (Y p )o< p <k+2 and (yp,y 2 )o< P <k+i- 
Using the independence of and y 2 for r < p < k + 1 and decreasing induction, one may 
clearly derive 



k U+ J2 yl) +A - ( h+ J2 h 

\ 0<p<T / \ 0<p<T 



For < p < r, from Lemma [TJ and again using decreasing induction, we also have 

Y p = log Ep exp — — Y p+1 

m p l + t 

< i g Ep exp (A p+1 (xl + y l p ) + (x 2 p + y 2 p ) ) (79) 

TT)jp .L I 7/ 

<— EpexpnipAp + i [x\ + ^) + — E p exp m p A p+1 (x 2 p + y 2 ) , 
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where x p = h + J2o< r < P ~i Up for j — 1> 2. In particular, if p — 0, Y < 2EA (h) = 2X . To 
prove flTHj) . we expect that when < t < 1, equality will not hold in f J79|) . and with the help 
of the condition f!77|) . the small difference between the two sides will keep accumulating 
over p. Let us emphasize that this should be true even in the absence of external field. 
A similar approach is also presented in Section 14.12 of Talagrand's book [12], where 
he considered the case t = 1 and used the Cauchy-Schwarz inequality to quantify the 
difference. However, in the case < t < 1, his argument no longer holds. We then resort 
to another approach using the Gaussian interpolation technique. 

Before we state our main estimate, for convenience, let us set up a definition. Let 
C\ > be a constant and y be a standard Gaussian r.v. Suppose that m and uj are two 
fixed numbers with < m < 1 and u > and A is a real-valued function defined on R 
such that 

Eexp mA(x + y\fw) and EA(x + y\/w) 
exist for x G R and < w < u. We define 



1 



T(x, w) = — log E expmA(x + y^/w). 



m 



10) 



Here, if m = 0, T(x, w) is defined as EA(x + yy/w). Then we say that A satisfies condition 
A(m, u, Ci) if 



dT 



dx 



< 1, 



Cich x dx 



8 2 T 
< -r—r < min 



Ci_ 
ch 2 x 



8 3 T 



dx 3 



< 4, 



<9 4 T 



< 



(81) 



for x G R and < w < u. 



Proposition 12. Suppose that A satisfies A(m,oj,Ci). Let y\,y2 be jointly Gaussian 
r.v.s with Ey\ = Ey\ = 1 and Eyiy 2 = t > 0. Let K > and L G N be fixed constants. 
Suppose that < a , ai, . . . , ate < K. Then there exist constants C°, Cj, . . . ,Cf satisfying 



C°,C 1 e ,...,C e i <4j2®n + K 1 



12) 



n=0 



for some constant K\ depending only on C\ and L such that for any given numbers 
Xi, X2 G R, < w < min (u, , w = 0, and < Wi,w 2 , . . . ,Wi < L, the following 
inequality holds 

1 — |— £ 777, 

log E exp (A(xi + yi^) + A(x 2 + y 2 Vw) 



m 



- a n F(xi + yiy/w, x 2 + y2\fw, w n ) 

n=0 
2 1 

< — log E exp mA(xj + yj \/w) 

3=1 m 

~y~][ ~ wC e"> + -Y m w5 {n) J F(x 1 , x 2 , (1 - 5 (n))w + w n ), 



(83) 



where C 



n=0 

t 



2(l+t)Cf 



and we define S (n) = 1 if n = and otherwise. 
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Let us explain how to use this inequality. Observe that the left-hand side of (I53"|) differs 
from (fTTl) by the t + 1 quantities 

(a n F(xi,x 2 , w n )) Q < n < e 
at the present stage. Most of them will be preserved in the new stage by 

(a n (l - wC2)F(x 1 ,x 2 , (1 - S (n))w + w„)) < n < £ 
with the additional term 

—tmwF(xi, x 2 , 0). 

So after one step, we obtain + 1) + 1 terms in the new stage. Continued iterations of 
fl83|) lead to a sum of these small quantities that will converge to some positive number if 
w is not too small at each iteration. This is the main reason we need the growth control 
on Cl Cj, C\ through (El . 

Now, we return to the proof of Proposition (TTJ Let k, m, q be a given triplet. Recall 
the definition of (A p ) < p <k+2 from ( TTHl) . 

Lemma 13. For each < p < k + 1, A p+X satisfies condition A(m p , (q p+1 ) , C) . 

Proof. Let 0<p<A; + lbe fixed. Suppose that < w < Cilp+i)- Note that £' is strictly 
increasing on [0, oo) and £'(0) = 0. Let q satisfy = £'(g p+ i) — w. Set k' — k + 1 — p. 
Consider 

m' : m' Q = 0, = m p , and = m n+p _i for 2 < n < k! + 1 
q' : g(, = 0, <^ = g, and q' n = q n+p -i for 2 < n < k' + 2. 

Let (-B n )o<n<fc'+2 be defined in the same way as (A p ) < p ^ k+ 2 by using the triplet k', m', q'. 
Then it should be clear that B 2 = A p and so 

Bi(x) =^ r log Eexpm'^ (x + y^£'(q p+1 ) - 

=— log E exp m p A„(x + yy/w), 
m p 

where y is a standard Gaussian r.v. Since (-B n )o<n<A;'+2 satisfies f|T9l) . this completes our 
proof. □ 

Proof of Proposition [11] : Let C be the constant in Lemma [2] and L be the smallest 
integer such that L > £'(1). Suppose that K\ is obtained from Proposition [T2l by using 
C\ = C and L. Again, without loss of generality, we may assume that C\ = q Sl ,c 2 = q S2 , 
and M = g a forl<Si<s 2 <a<A; + 2. Let us consider the following numbers 

A =0 
r =a 
k =k + 1 



m 



n 



v t+1 



— if < p < t and m p if r < p < k 



p p =q p for < p < k + 1. 
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From dSJ, 

Pu,n < 21og2 + F - rn p (6(q p+1 )-0(q p )). 

0<p<fc+l 

Recall the definition of (yp,yp)o< p < K from Theorem [21 We define Y a (xi,x 2 ) = A a (xx) + 
A a (x 2 ) and for 1 < p < a, 

Y p (x 1 ,x 2 ) = logEexp — ^-Y p+1 {xi + y \,x 2 + yl). 

m p 1 + t F y 

Finally, Yo(xi,X2) = EY\{x\ + y\,x 2 + y$). It is obvious that Y = EY (h,h). From 
Proposition we know Y a3 (x 1 ,x 2 ) < A S2 (xi) + A S2 (x 2 ). Set 7] p = £'(q p +i) - £'(q p ) for 
< p < k + 1. Suppose that r] Sl ,r] sl+1 , . . . , r/ S2 _ 2 , r) S2 -i satisfy 

< V P < -7 \ (84) 

2 (2C En= P+ l m n Vn + K X ) (s 2 - Sj) 

for si < p < s 2 — 1. We claim that for si < p < S2, 

S2-1 / n-l \ 

F p (xi, x 2 ) <v4 p (xi) + A p (x 2 ) - ^ Pn, P F v I x u x 2 , y^Vij , (85) 

n= P \ l=p / 

where 

Pn,p „ If^nVn I *■ 

2 V s 2 -si 

Clearly, if p = s 2 , then (185|) is true. Suppose that (1531) holds for some p + 1 with s% < 
p + 1 < s 2 . Let us consider the following numbers 



m =m p 



s 2 -p-l 

(86) 



«o =0 and a n = P n + P , P +i for 1 < n < 

+p-'- 
=p+i 



w =0 and u> n = Ya=p+i Vi for 1 < n < ^ 



From the definition of u> n , we know that < w n < £'(1) < £ for < n < £. Since 
A p+1 satisfies A(m p , £,'(q p +i), Ci), applying fl86l) to Proposition [121 we obtain (C™)o<n<^ 
satisfying (E2D , that is, 

1 s 2 -i 
C £ °,C £ 1 ,...,^<4^a n + ^ 1 <2C ^ m A + ^. (87) 

n=0 n=p+l 

Using ([HID an d (IST]) . we know < r\ v < and moreover, 

( S2_1 \ 1 1 

C"rip < 2C V m n r] n + K x ] rj p < — < 

» ^ ' 2(s 2 -si) s 2 -s 1 



n=p+l 
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Let w = Tj p . If u > 0, then (1551) holds since 
F p (xi,x 2 ) <A p (xi) + A p (x 2 ) 

c 

^-mwF(xi, x 2 , 0) — a n (1 — C%w) F(xi, x 2 , w + w ri 



2 

n=l 



si-1 / n— 1 

<A p (xi) + A p (x 2 ) - -ymp77pF(xi,x 2 ,0) - ^ /3„ iP F I xi, x 2 , ^ 77, 

ra=p+l \ ; =p , 

If M < 0, then 

A p+1 (x 2 + y 2 p ) = A p+1 (-x 2 - y 2 p ) (89) 
F-x{x\ + y l p , x 2 + w n ) =F(xi + yl, -x 2 - y 2 p , w n ) 

and it follows by applying (y\,y 2 ) = (y p , —y p ) to Proposition [T2l that 
Y p (xi,x 2 ) <A p (x 1 ) + Ap(-x 2 ) 

c 

— —mwF(xi, -x 2 , 0) - 2J «n(l - C2w)F(xi, —x 2 , w + w p ) 



n=l 

si— 1 / n— 1 



<Ap(a?i) + A p (a; 2 ) - -^m p r/ p F_i(a;i, x 2 , 0) - \] /?n,p-F- I £2, 2J 

n=p+l ^ 



where again, we use ( I88|) for the second inequality. This completes the proof of our claim. 
Next, set 7 Sl , aa = 2Cq Yln=s m nVn + K\ and assume that for < p < si, 



0< Vp < — !— . (90) 



We claim that for < p < si, 

F p (xi,x 2 ) <Ap(xi) + Ap(x 2 ) 

fsi — 1 \ S2 — 1 / n— 1 

- 2 7si,, 2 5^ m I X] ^.'i^ I x i> X2 ' ^ 



(91) 



i=P / 71=Sl \ i=p 



If p = si, then (|9"T1) holds by (!85|) . Suppose that (|9"T1) is true for some p + 1 with 1 < 
p + 1 < si. Let us consider the following numbers 



t =s 2 - s 1 
m =m p 



( s -\ \ (92) 

a =0 and a n = exp ( -27 Sl)S2 YfiLp+i Vi) 0n+ Sl -i, Sl for 1 < n < i 

w =0 and w n = ]C"=p+7 2 Vi for 1 < n < 
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As in our first claim, since < w n < £'(1) < L for < n < k and A p+ i satisfies 
A(m p , (q p+ i) , Ci) , we can apply Proposition [121 with fl92|) to obtain (C")^ =0 satisfying 
(PD , that is, 

C?, C?, . . . , < 4 ]T a n + K, < lsuS2 . (93) 

n=0 

We conclude from ([90]) and ([93]) that < r? p < ^ and C^p < 1/2 for < n < i. Note 
that 1 — x > exp(— 2x) if x < 1/2. This and (1931) together imply 

1 - Q n r/ P > exp (-2C^ p ) > exp {-2 1si . S2 t 1p ) . (94) 

Set w = rj p . Now, if u > 0, using ( f9~4"l) . we obtain 

3^(xi,x 2 ) <A p (a;i) + A p (x 2 ) 

- -^m p rj p F(x 1 ,x 2 ,0) 

tsi — l \ S2 — 1 / n— 1 

Z=p+1 / n=si \ l=p 

<A p {x x ) + A p (x 2 ) 

tsi — l \ S2 — 1 / n— 1 

- 2 7si,, 2 ^ »7i I @ n >^ F ( Xl ' X2 ' ^ 
i=p / n=si \ i=p 

If m < 0, we obtain ( f9~TT) by using ( ]89l) . applying (1/1,2/2) = (?/p, — 2/») to ( |85l) . and a similar 
argument as in the case u > 0. This completes the proof of our second claim. 

Now, let p = in f l9T|) and notice that 7 Sl)S2 < 2Co£'(l) + K 1 and m n > | for n > s\. 
We then obtain 

Y =EY (h,h) 

<2EA (h) - ^ exp (-2(2^(1) + #i)£'(l)) 

Since we can partition [ci, c 2 ] so that max Sl < p < S2 _i ?7 P is arbitrary small, by passing to the 
limit, 

Y < 2X - ^ exp (-2(2C e'(l) + ^i)e'(l) - 1) J* EF v {h,h,?(q))e{q)dq 

and we are done. □ 
At the end of this section, we will prove Proposition [12] and we proceed by two lemmas. 
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Lemma 14. For any x\,x 2 € R, < w < |, and iu' > 0, we have 

F(xi, x 2 , w' + w) > ^-F(xx,x 2 , w'). (95) 

Proof. First we prove that for ii,^ G K and < w < -g, 

F{x u x 2 , w)>{1- Aw)F{x 1 ,x 2 , 0). (96) 

If (J96D holds, then 

F(xi,x 2 ,w) > -F(xi,x 2 , 0) 
whenever Xi, x 2 G R and < u> < ~ and this implies (195]) since for u>' > 0, 



F(xi, x 2 , w' + w) =EF(xi + yivw 1 , x 2 + y 2 Vw' , w) 
>^EF(xi + yx^', x 2 + y 2 VuS, 0) 

=^F(x 1 ,x 2 ,w'), 

where y\ and y 2 are jointly Gaussian r.v.s. with E^) 2 = E{y 2 ) 2 = 1 and Ey\y 2 = t. To 
prove (1961) . for fixed Xi,x 2 , let us set <p(w) = F(xi,x 2 ,w). Define G(x,y) = (thx — thy) 2 . 
Using Gaussian integration by parts, we have 

V?'(0) =~ (Gii(xi,x 2 ) + G 22 (x 1 ,x 2 ) + 2tG 12 (xi,x 2 )) 

= (tha;i — thx2)(th"xi — th"x 2 ) + (th'xi — th'a^) 2 + 2(1 — t)th'xith.'x 2 
>(thxi — thx2)(th"xi — th"x 2 ). 

Since 

th"xi — th"x2 = 2(thxi — thx2)((thxi + thx 2 ) 2 — 1 — thxitha^), 

we have <^'(0) > — 4(thxi — thr 2 ) 2 - We may also compute the second derivative of f and 
this yields that \ max <^<i |y/'(w;)| < C, where C is a constant independent of t, w,xi,x 2 . 
So 

F{x u x 2 , w) = <p(w) > <p(0) + tp'(Q)w - Cw 2 > (1 - Aw)F(x h x 2 , 0) - Cw 2 . 

Set Si = wi/N. It is easy to see by induction 

F( Xl ,x 2 , Si) > (1 - ASiYFixt, x 2 , 0) - CiS\ 

for 1 < i < N. In particular, if we put i = N and let N tend to infinity, we obtain 
F(xi,x 2 , w) > exp(—4w)F(xi,x 2 , 0) > (1 — 4w)F(xi, x 2 , 0) and this completes the proof. 

□ 

Lemma 15. Suppose that A is a function defined on R satisfying 

i^ 1 - c^^'M^O-sb)' l ^ >1 - 4, '• 4 ' 4)| - 8 
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for some constant C\. Let 1/1,1/2 be jointly Gaussian r.v.s with Ey\ = Ey\ = 1 and Ey^y 2 = 
t > 0. Let K > and L e N be fixed constants. Suppose that < a , a±, . . . , at < K. 
Then there exist constants 

K 1 depending only on C\ and L, 

e 

C\, C\, . . . , C[ < «n + K u and 

n=0 

Cp +1 depending only on £ and K 

such that for any given numbers x\,x 2 € M, < m < 1, < w < |, w — 0, and 
< wi, W2, ■ ■ ■ , we < L, the following inequality holds 

1 + t 



■ log E exp ( M?i + yiVw) + M x 2 + V2\/w~) 
- a n E(x 1 + i/iv 7 ^, x 2 + y 2 y/w, w n ) 

n=0 

2 ( . _ 

< — log E exp mA(xj + yjy/w) ^ ' 



m 

i 



m 



- ^2 ( a n (1 - Cfw) + C mw5 (n)) F(xi, x 2 , (1 - S (n))w + w n ) 



n=0 



+ c< +1 < 

where C = 2 (i+t)c' 2 an( ^ ^o( n ) — 1 if n — and otherwise. 

Proof. Suppose for the moment that (yi, y 2 ) are jointly Gaussian with E{i)i) 2 = E{y 2 ) 2 < 
I and Ey\y2 = tE(yi) 2 . Let (zi,z 2 ) be an independent copy of (yi,y 2 ). Define (zi,z 2 ) = 
(0, 0) and for 1 < n < £, (z™, z 2 ) = (z±, z 2 ). For convenience, we set for j = 1, 2, 

Aj(x) =A( Xj +x) 
thj(x) —th(xj + x) 
U j( u ) =VjVu 
and for j — 1,2 and n — 0, 1, 2, . . . , I, 



V n ,j(u) =y jV ^L + z]VT 



u 



3 

G n (u) =F(x 1 + Vn 7 i(u),x 2 + V nt2 (u),w n ) 
G ri j{u) =F j (x 1 + V n;1 (u),x 2 + V n , 2 (u),w n ) 
G n ,ij(u) =F ij (x 1 + V njl (u),x 2 + V nj2 (u),w n ), 

where Fj is the partial derivative of F with respect to the j-th variable and F^ means 
the second partial derivative of F with respect to i-th and then j-th variables. Define the 
interpolation functions 

tp(u) =E z ip{u) 
ipj(u) =ipj{u), j = 1,2, 
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where 



m 



fit 



and 



T(u) =exp^ (a^u)) + A 2 (U 2 (u)) -J^a n G n (u)j 



Tj{u) =expmAj(Uj(u)). 



Then 



r 1 ) =i^logEexp 7-7-7 ( ^i(yi) + A 2 (y 2 ) - S ^2a n F(x l + y u x 2 + y 2 , w n ) 

n=0 



m 



l + t 



(p(0) =y?i(0) + (p 2 (0) - oi n E z F{x x + z?, x 2 + z%, w n ). 



?1=0 



In the following, we will try to find an upper bound for <f'(0). Consider 

" 2 / I 

U' 3 {u)A' 3 {U 3 {u)) - X)«nV^-(«)G BJ -(«) ) T(«; 



j'=i 

e 



n=0 



^0(«)-^On(JT(«) + ^(«)), 



n=0 



where 



J (u) 



1 



and for j — 1,2 and n = 0, . . . , £, 

1 



J"{u) 



-E„ 



(y 1 A[(U 1 (u))+y 2 A' 2 {U 2 (u)))T(u) 



u 



E y T(u) y 

Using Gaussian integration by parts on y, we have 

Mo) 

=Ey(yi) 2 J2 K(°) + YT t A 'M - E«nG BJ -(0) 



G nJ (u)T(u) 



n=0 



K_E v ( yi ) 2 (4(0) ( A 2 (0)-^a n G n , 2 (0) ) +4(0)( J 4;(0)-^«A,i(0) 



n=0 



ra=0 



^(yi) 2 (4(0)-T^-(Jo 2 (0) + ^(0))), 



l + t 
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where 

Jo(o) = tffl + ™4(°) 2 ) - (^i(o) - 4(o)) 

J 2 (0) =(^(0) - A' 2 (0))^a n (G n ,i(0) + tG„, 2 (0)) 

n=0 

J 3 (0) =(1 + t)A' 2 (0) ^ a n (G nA (0) + G n , 2 (0)) . 



n=0 



Let us try to find an upper bound for Jq(0) first. Since 



1 <A"(x)< Cl 



Cich 2 x ch 2 x' 
it is easy to see from f|95|) that 
1 



—F{x 1 ,x 2 ,w ) <K(0)-A' 2 (0)) 2 

<C 2 F(xi,x 2 ,w ) 
<2 SL+1 C 2 1 E z F{x 1 + z^x 2 + z%. 



Since 



(9* 



9 

— (thix - th 2 y) 2 =2(1 - th 2 x)(thix - th 2 y) 
ox 

-^-(thtx - th 2 y) 2 =2(1 - th 2 2 y)(th 2 y - th x x), 

from the Cauchy-Schwarz inequality, we have 

E z G n j(0) 2 
=E z F J (x 1 + z^x 2 + z^w n ) 2 

=E Z (2E y , [(l - th 2 (zj + y'j^UQ) (thi(^ + y[^fUQ - th 2 (z£ + y' 2 ^Q)]) 2 (99) 

<4£ 2 £y (thx(^ + yiV^) - th 2 (4 + 2/ 2 vW)) 2 
=4E z F(xi + z]*, x 2 + 2%, w n ) , 

where y[,y' 2 are jointly Gaussian r.v.s with E^) 2 = E{y' 2 ) 2 = 1 and Ey[y 2 = t. Straight- 
forward computation yields 

d d 

— (thix - th 2 y) 2 + — (th lX - th 2 y) 2 = -2(th lX - th^f^x + th 2 y) 
ox Oy 

and this implies 

E z \G n>1 (0) + G n>2 (0)\ <AE z F(x 1 + zlx 2 + z^w n ). (100) 
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Now, combining 



(llOOp . and using Jensen's inequality, 



mt 



n=l 



(1 + t)Cl 



F(x 1 ,x 2 ,w ), 



E z \J 2 (0)\ < \A[(0) - A' 2 (0)| {{E z G n M 2 ) l/2 + t {E z G n , 2 (0) 2 ) 1/2 

n=0 

t 

<2(1 + t)\#M - A' 2 (0)| ®n (E z F( Xl + z?, x 2 + zl w n )) 1/2 

n=0 

t 

<2 4L+ IC 1 (1 + t)J2a n E z F(x x + z",x 2 + z$,w n ), 



n=0 



and 



E*\J%{0) I <4(1 + t) UnE z F{ Xl + zl x 2 + 7%, w n ). 

n=0 

To sum up, we obtain that 

2 

^J Q (0) <E y ( yi f J2( A "(°) +mA' j (0) 2 ) 

t 



+ mE y {y l ) 2 Y^(a n {2 iL ^C l +A) 

n=0 ^ 



(l+t)Cl 



5 (n) 



(101) 



Next, let us turn to the computation of J". By using Gaussian integration by parts 
on y, we obtain 

■X=E y {yxG n ,x(u)T{u)) 



G n>ll (u) + ^- t G n}l (u) Ia[(U x (u))-J2<xi g iAu)))t(u) 



--E y (yi) 2 E y 



+ E y {y x y 2 ) E y 
and this implies that 



G n>12 {u) + ^-G njl {u) A' 2 (U 2 (u)) - <xiG l>2 {u) T{u) 



lim E z 

M->0 



y/uE y T(u 



-Ey (yxG^i^Tlu)) 



--E y ( yi ) 2 (E z G n!ll {0) + tE z G n , 12 (0) + (i? + WJ)J 



(102) 
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where for < n < 



I? =E Z 



I 2 =Ez 



G n ,i(0) Lli(0)-^a,G,,i(0) 



G»,i(o)U(o)-E a A2(o) 



On the other hand, letting u — > and then using Gaussian integration by parts on z, we 
also have 

1 



lim E z 



-E 



\/T— uE y T(u 



-E y (z?G nil (u)T(u)) 



-z?G n!l {0)E y T{0) 



_EyT(0) 

E z [zfG^O)] 

E z {zlf (E z G n>u (0) + tE z G n>12 (0)) . 



(103) 



So from (THE]) and fTTOBl . 



lim E z J™(u) = lim £L 2 



1 



2/1 



G? n> i(tt)T(w) 



=E v (y i y U (n) (G ,ii(0) +tG ,i 2 (0)) 
We may also compute lim^o E z J£(u) and this yields 



m 

T+t 



(104) 



lim ^(«) + =5 (^)^(z/i) 2 /o + m f^ l)2 ((A n + i?) + + I4)) , ( 105 ) 



where I Q = G ,n(0) + G , 22 (0) + 2tG 0>12 (0) and for < n < 



Jg =E Z 



12 =E Z 



G n>2 (0) [A' 2 (0)- ^a,G,, 2 (0) 



G n , 2 (0) ii(o)-E«Ai(o) 



Let us now try to find a suitable lower bound for (j!05p . Observe that 

thi(0),th' 2 (0) >0 
thi(0) - th' 2 (0) = - (thi(0) - th 2 (0))(thi(0) + th 2 (0)) 
th?(0) - th 2 '(0) =2(thx(0) - th 2 (0))((th 1 (0) + th 2 (0)) 2 - 1 - thi(0)th 2 (0)). 
This implies 

J =2(thi(0) - th 2 (0))(th;'(0) - th 2 '(0)) + 2(^(0) - th' 2 (0)) 2 + 4(1 - t)thi(0)tl4(0) 
>2(thi(0) - th 2 (0))(thi'(0) - th 2 '(0)) 
> -4(thi(0) -th 2 (0)) 2 
= - AF(x 1 ,x 2 ,w ). 

(106) 
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As for the upper bounds for \I£ + Ig | and j/^ 1 + 14 |, we write 

1 1 "T J 3 — ± ll ~r 1 12 1* J 13 

1 2 J 4 ~ 1 21 1 22 J 23> 



where 



[G njl (0) (Ai(0)-^(0))] 
7" =£ 2 [G Bi2 (0) (4(0)- 4(0))] 
^=^[4(0) (G n>1 (0) + G n , 2 (0))] 

7 2 " 2 =£,[4(0) (G„,i(0)+G n , 2 (0))] 

1 

J i n 3 = - [(G„,i(0)G u (0) + G n , 2 (0)G z , 2 (0))] 



1=0 



^23 = - [(G„,i(0)G, 2 (0) + G n , 2 (0)G w (0))] . 



1=0 



Using (1981 . fl99|) . and Jensen's inequality, we have 

< (^G n ,,(0) 2 ) 1/2 |4(0) - 4(0)| < 2 4i +§C 1 £ z F(x 1 + z",x 2 + (107) 
From f llOOp . we also have 

|i£| <4^F(x x + ^,a; 2 + ^,ii; n ). (108) 
To bound |/ 7 n 3 |, we use a& < and (EHJ. Then this leads to 



1 1 

^9 E 011 ( G nM 2 + Gn,2(0) 2 + G U (0) 2 + G ii2 (0) 2 ) 



2 

2=0 



^ 2 ,^nJ- 



(109) 



<4 I E a ' ] E * F ( x i + ' x 2 + 4, »n) + 4 ^ aiE z F{ Xl + z[,x 2 + z l 2 , w t ). 

\l=0 ) 1=0 

Now, combining (ITUBD . ffTUTD . (ITO . and (fTU0"j) together, we obtain from (jTD5]l . 
(^Jf^ + ^J^O)) 

n=0 

> - 4a Q 5o(n)£; 2/ ( 2 /i) 2 F(xi, x 2 , u> ) (110) 
- mE y ( yi ) 2 £ an ( 8 E + 2 4L+ 5C! + 4 j + 4, x 2 + 

n=0 \ «=0 / 

From now on, we replace (yi,y 2 ) by (yiy/w, U2\/w) with E{yi) 2 = 1. Combining (jlOip 
and f lllOp . we get 

*/(0)<!X>;'(0)+m4(0) 2 ) 

(111) 

+ w E (a n C" - C m<5o(n)) F(xi, x 2 , (1 - <J (n))w + w n ), 

n=0 
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where C = 2 (i+t)c' i anc ^ ior < n < £, 



C« = 4m a i + 2 4L+ ^md + 4m + 25 (n) 



1=0 

It is easy to compute that 

^(0) = |(4(0)+mA;.(0) 2 ). 

We may also use Gaussian integration by parts and the given conditions on the first four 
derivatives to compute the second derivatives of (fi, <p 2 , and cp and this yields 

\ max {\ V '[{u)\ + |^(«)| + |^(«)|) < C{^w\ 
z o<«<i 

where C^ +1 depends only on i and K. Finally, we finish by using the mean value theorem 
and (pHD, 

¥>(l)<¥>(0) + ¥>'(0) + i max>»| 

Z 0<M<1 

<^(1) + ^ 2 (1) 

- (a n (l - C?u>) + C mw5 (n)) F(x u x 2 , (1 - S (n))w + w n ) + C e e +1 w 2 . 

n=0 

□ 

Proof of Proposition [12] : Recall that Lemma [15] guarantees the existence of constants 
Cq, C°, . . . , Cf, which satisfy ( 182|) . From (!97t) . we only need to prove that C e e +1 can be 
eliminated. To do this, we will use the constant C^ +1 obtained by replacing K by Cquo + K 
in Lemma [TBI Let us keep m, t, a , . . . , act, and w, w , w\ . . . , fixed. We use <p(xi,x 2 , w) 
to denote the left-hand side of ([SB]) . Recall the definition of T(x,w) from (15U1) . Set 
Si = wi/N for 1 < i < N. We claim that for every 1 < i < N, the following inequality 
holds 



<p(xi,x 2 ,6i) <T(xi,5i) + T(x 2 ,Si) - y^ y /3 n7 jF(xi,x 2 , (1 - S (n))5i + w n ) + iC E e +1 5l, 

n=0 

(112) 

where 

i 

Pn,i = WComd, (1 - C^y- 1 + a n (l - C^y. 
If i = 1, then ( !97l) implies ( 11 12H . Suppose that ( 1 1 12f) holds for some i with 1 < i < N. 
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Then 

l + t 



tp(x 1: x 2 , 5 i+ x) = log E exp —^7— ((f{xx +yiv^i,x 2 + y 2 \/5i,5i)) 

m 1 + 1 V / 

1 -|- t 171 f — 1 — 

< logEexp — — - \T{x\ +yiVS 1 ,6 i ) + T(x 2 +y 2 y / 6i,5 i ) 

m 1 + t \ 

e 

- ^ p n ,iF{x 1 + y\y/8[, x 2 + 2/2 V&i, (! - ^(/O)^ + it',, 

n=0 

+ lr2 



<T(xi, 5 i+ i) + T(x 2 , 5 i+1 ) 



- (S (n)C m5 1 + nji (l - C^8 X )) F(x h x 2 , (1 - S (n))8 i+1 + 

n=0 

+ (i + 1)C?W V 



Here, the first inequality holds by using the induction hypothesis. The second inequality 
is obtained by observing the fact that f3 n ^ < Cquj + K and T(-, 5i) satisfies A(m, 6^^, C\) 
and applying ( |9"7|) . Since 



5 {n)Cvmh + l3nA^-C^i) 

i 

=5 {n)C m5 1 + 5 {n)C m5 1 ^ (l - C?<J 1 ) i + « n (l - C^S 1 ) i+1 

3=1 

i+l 

^8 (n)C m5 1 ^ (l - Cj<J 1 ) i " 1 + - C^) m 

this completes the proof of our claim. Letting z = A" in (j!12p and then A" — >• 00, we 
obtain that 

(p(xi, x 2 , w) <T(x 1 , w) + T{x 2 , w) 

1 

— ^o^Comw exp (— C°it;) + a n exp(— C™w)) 

n=0 

■ F(x u x 2 , (1 - S (n))w + w n ). 
Since exp(— x) > 1 — x for x > 0, we are done by letting < w < -^u- □ 
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